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Abstract 


Let A be an n-by-n matrix with index a > 0 and b € C”. In this paper, 
the problem of stagnation of the D@MRES method for the singular linear 
system Az = 6 is considered. We show that DGMRES(A, b, a) has partial 
stagnation of order at least k if and only if (0,...,0) belongs to the the joint 
numerical range of matrices {B°+1,..., B°+*}, where B is a compression 
of A to the range of A®. Also, we characterize the nonsingular part of a 
matrices A such that DGMRES(A, b,a) does not stagnate for all b € C”. 
Moreover, a sufficient condition for non-existence of real stagnation vectors 
b € R(A®) for the DGMRES method is presented, and the D@MRES 
stagnation of special matrices are studied. 
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1 Introduction 


Let A be an n-by-n matrix with index a. The index is the size of the largest 
Jordan block of A corresponding to the zero eigenvalue. The Drazin inverse 
AP of A is the unique n-by-n matrix that satisfies 


AAP SAMA, BV AP aA, AMAA = A. 


Since A? can be written as a polynomial in A [2, p. 186], there is a possi- 
bility of using Krylov subspace methods to find the Drazin inverse solution 
AP to a possibly inconsistent linear system Ax = b. Such an algorithm, 
called DGMRES, developed by Sidi [7]. DGMRES has been considered in 
several studies; see [1, 8]. This algorithm is similar to the GMRES algorithm 
developed by Saad and Schultz [6] for solving nonsingular linear systems. 
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The stagnation of GMRES was studied in [3, 5, 10] and the stagnation of 
DGMRES was studied in [11]. 

Note that while the linear system Ax = b may have no solution, if we 
multiply each side by A®, then the linear system A°+!x = Ad is consistent 
and has « = A?b as a solution. The DGMRES algorithm works as follows. 
Given an initial guess 79, compute the initial residual r9 = b — Azo. We will 
choose approximate solutions z,, k = 1,2,...,n—a, to be of the form xo 
plus a linear combination of vectors from the kth Krylov subspace 


Ky (A, A“ro) = span{ Aro, os alee 1 (1) 
such that the residual vector rz, = b — Ax, satisfies 


|A°re|] = mingek,(A,A%ro) || A (b — A(xo + 2)|| 
en ||A*(b — A(to + 1 AWro Fe + cpAet*-179))|| 


= mine,,....c, || A°ro — (4 A2t1 pg — 2 = cp A2>tFro)) |]. (2) 


= ming, 


The DGMRES terminates with the exact Drazin-inverse solution in at 
most n — a iterations (i.e., || A°rn—a|| = 0) [7]. Throughout this paper, || - || 
denotes the Euclidean norm for vectors and the spectral norm for matrices. 
Without loss of generality, we assume that zp = 0 and ||A®ro|| = || A%d|| = 1, 
because if A°ro = 0, then the DGMRES algorithm has the solution zo at the 
initial step, in other words, the DGMRES algorithm has no progress. 


Definition 1. Let {A1, Ao,..., Ax} be n x n matrices. The joint numerical 
range for (A, A2,..., Az) is defined and denoted by 


W (Aj, Ao,..., Ag) = {(a* Ara, v* Aow,...,u* Apv): a € C",x* x = 1}. 


Note that in Definition 1, if & = 1, then the joint numerical range coincide 
with the standard numerical range. 


2 Partial stagnation of D@MRES 


In this section, the problem of stagnation of the DGMRES algorithm for 
singular linear system Az = 6 is studied. 


Definition 2. Let A be an n-by-n matrix with index a and a right-hand 
side vector b € C”. We say that DGMRES (A, b, a) has partial stagnation of 
order k, if 


| A° rol] = +++ = ||A°rel] > |[A&regil] 2 +++ 2 |Aern—all =0. (3) 
Also, if DGMRES (A,0,q) has partial stagnation of order k = n—a—1, 


then DGMRES (A, b,a) has complete stagnation. DGMRES (A, }, a) does 
not stagnate, if DGMRES (A, }, qa) has not partial stagnation of any order. 


IJNAO, Vol. 12, No. 3 (Special Issue), 2022, pp 533-541 


On stagnation of the D@MRES method 535 


In the following result, we state an equivalent definition for partial stag- 
nation [11]. 


Lemma 1. Let A be an n-by-n matrix with index a and a right-hand side 
vector b € C”. Then DGMRES (A, b,a) has partial stagnation of order at 
least k if and only if A%b is perpendicular to span{ A2°+1b,..., A?¢+*d}. 


Proof. By using (2), we obtain that for all 1 <i<k, 


A%) — @ APT — --» — G A2°*"B)) ||. 


|| A*b|| = ming,,...,¢; 


Therefore, A%b should be perpendicular to span{ A?°+1b,..., A?¢+*b}. 


By using the Core-Nilpotent decomposition and QR decomposition, we 
obtain the following decomposition [1]. 

Let A € C"*” with a = ind(A) > 0. Then there exists a unitary matrix 
Qe C"*” such that 


A=al6 x Q, (4) 


where B € C”*"™ is the compression of A to R(A®) and N is nilpotent with 
index a. 


Theorem 1. Let A € C"*” with index a be as in (4). Then there exists a 
vector b € C” such that DGMRES(A, b, a) has partial stagnation of order at 
least k if and only if (0,...,0) € W(B?*1,..., B°t*). 


Proof. By Lemma 1, we know that the DGMRES(A, b, a) has partial stag- 
nation of order at least k, if and only if (A%b)*A?°t*b = 0, 7 = 1,...,k. 
Then 

(A%)*(A°*) (4%) =0, b= 1)... ke. (5) 


By using (4) and (5), for i=1,...,k, 


(avy (ae y(a%0) = (428)°Q | FQ” ass | (AD) 


+t y 


=a [Py gf ea=0. 6) 


Define z = (31) = Q*(A%b), where z, € C™. Since 0 # A%b € R(A®) and 
the last n — m columns of Q form an orthonormal basis for the R(A®)+, we 
obtain that z2 = 0 and hence ||z|| = ||z|| = ||Q*(A%b)|| = 1. Therefore, 


p Bott x 
ile <Ge 3G 


]e= abt =0, 91)... k (7) 


This means that (0,...,0) € W(B°*1,..., B°**). 
Conversely, assume that (0,...,0) € W(B°t!,...,B°*+*). Then there 
exists a unit vector 2; € C™ such that z*B°**z; = 0, i =1,...,k. Define 
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z= (%) © C”. Then (7) holds. We know that the first m columns of Q form 
an orthonormal basis for the range of A*. Then Qz = Q(%) € R(A®), and 
hence the equation A°x = Qz has a solution « = b. Since z = Q*(A“%b), by 
using (7) 


* Qa * Bers * Qa * Pati . 
(Q*(A%))" |" 9 9 | (Q*(A%)) = ABM a =0, = 1,...,8. 


Therefore, (A%b)*(A%**)(A%b) = (A%b)*(A2°**b) = 0, ¢ = 1,...k. This 
shows that A%b is perpendicular to A?°+’b, i =1,...,k. Then by Lemma 1, 
DGMRES(A, b, a) has partial stagnation of order at least k. 


3 Complete stagnation of D@MRES 


Let A be an n-by-n matrix with index a and let b € C”. By Definition 2, we 
know that DGMRES(A, b, a) has complete stagnation if 


| A°rol| = +++ = A°rn—a—all > ]A°rn—all = 0. (8) 


In the following result, we show that ||A°rm|| = 0. 


Theorem 2. Let A € M,,(C) with index a be as in (4) and let b € C”. Then 
A°rm = 0, where m is the dimension of R(A%), the range of A®. 


Proof. The matrix B € M,,(C) is nonsingular, so by using the Cayley— 
Hamilton theorem, there exists a polynomial of degree at most m— 1 say 
p(x) = @m—1x™ 1 +--+ +a," + ao such that (B~1)°t! = p(B). Then by [2, 
p. 186] the Drazin inverse A? = A%p(A). Then 
| A°rm || =minzex,, (A.A) lA% (6 — Ax)|| 
=miny,,...tm_1||A°b— Aer (tod + + + tm A™ *d)]| 
<||A%b — A2°*! (agb +--+ + a1 A™ *0)|| 
=||A%b — AST" [A*p(A)]d]| = ||(A* — A2*7 A” )o)]]. (9) 


Since A%+1AP = A®%, we obtain that || A%r,,|| = 0. 


Remark 1. Theorem 2 shows that the D@MRES method terminates at most 
after m iterations. Then the complete stagnation occurs ifm =n— a. This 
means that the nilpotent part N in (4) must be equal to the Jordan block of 
size a corresponding to zero eigenvalue, N = J,(0). 
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4 Stagnation of real matrices 


Let A € R"*” with a = ind(A) > 0. Then by the core-nilpotent and QR 
decompositions for real matrices, there exist an orthogonal matrix Q € R"*”, 
an invertible matrix B € R™*"™, and a nilpotent matrix N € R™7™*"—™ 
such that (4) holds. Let A € R"*” and let e € R”. Then easy computation 
shows that 

e’ Ae = 0 if and only if e7(A+ A’ )e =0. 


Let A € R”*” be as in (4) with a = ind(A) > 0. If we are looking for 
a real stagnation vector e € R(A®%), it is enough to consider the following 
polynomial system: 


ef (APH 4 (AM )T)e=0, §=1,2,...,k, eTe=1. (10) 


Meurant [4, Theorem 2.2] presented a sufficient condition for non-existence 
of real stagnation vectors b € R” for the GMRES method. In the following 
result, we state a sufficient condition for non-existence of real stagnation 
vectors b € R(A®) for DGMRES method. 


Theorem 3. Let A € R”*” with a@ = ind(A) > 0 be as in (4) and let 
B:= Bt+(B)?, i=at1,a4+2,...,a+k, where k < m is a natural 
number. If there exist real scalars u;, 7 = 1,2,...,k such that the matrix 
Hi Basit:::+urBa+r is a (positive or negative) definite matrix, then there 
is no real stagnation vector e € R(A®). 


Proof. Assume if possible there exist a real stagnation vector e € R(A®). 
Then there exists b € R” such that e = A%b and (5) holds. By using the 
notations z = (3!) = Q7(A%b) with ||z1|| = 1 in Theorem 1, we obtain that 
a) Bos = 0, 4 = 1. j,k; By (0), 2f (BO + BP" a = 2) Beat = 
0,i=1,...,k, and hence 27 (1 Basit-::t+upBoa+e)21 = 0. Since uy Basit 
+++ + UpBoa+r is (positive or negative ) definite, we obtain that z; = 0, a 
contradiction with ||z;|| = 1. 


12 1 
Example 1. Let A be as in (4), where B= {1-1 2 | and N= ce : 
00 
10-1 
96 30 44 
It is readily seen that 10B2 + Bs = | 30 62 —1] is positive definite, where 
44 —1 44 


By = B? + (B?)” and Bs = B? + (B*)?. Then by Theorem 3, there is no 
real stagnation vector. 
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5 Stagnation of special matrices 


Let A be as in (4). If m = 0, then A is nilpotent with index a, which 
means that A* = 0, and hence A%b = O for all b € C”. Then without 
loss of generality, we assume that ||A%b|| = 1 throughout this paper. Also, 
we assume that m > 0, which means that B € M,,(C) is invertible and A 
is not nilpotent. In this section, we are going to characterize all matrices 
B€M,,(C) such that DGMRES(A, b, a) does not stagnate, for all b € C” 
and unitary matrices Q € M,,(C). 

The decomposition (4) is known as the core-nilpotent decomposition of 
A. Moreover, the matrix B is nonsingular. On the other hand, this decom- 
position is shown by A= BON. 


Theorem 4. Let B € M,,(C) be an invertible matrix and let N € Mp_—m(C) 
be a nilpotent matrix with index a. Then B°*+! is a scalar matrix if and 
only if D@MRES(A, b, a) does not stagnate for any b € C” and invertible 


4 _ BOl.,-4 
VeM,(C), where A=V [9 y]¥ : 


Proof. Assume that B°t+! = XJ, is a scalar matrix, where \ 4 0. Let b € C” 
be an arbitrary vector and let V € M,,(C) be an arbitrary invertible matrix. 
Assume that V = QR is the QR decomposition of V. Then 


lB 0) sa alt ee 1B 0) eR = : 
A=v|o NY -0|4 Palreall 0 FR @ 
_,{[RiBRy « : 
-0| 0 ec. 


Note that R2NR5" is again a nilpotent matrix with index a > 0 and that 
R, BR, = XIm is a scalar matrix. Since 0 ¢ W((Ri BR{')*+1) = {A*+4}, 
by Theorem 1, DGMRES(A,b,a) does not stagnate, for any b € C” and 
VeM,(C). 

Conversely, let DGMRES(A, b,a) do not stagnate for any b € C” and 
let V € M,(C). Assume if possible B°t! is not a scalar matrix. Then 
by [9, Theorem 3], there exists an invertible matrix V; € M,,(C) such that 
OE Whey: Let V; = QR, be the QR decomposition of V;. Define 


the matrix V := a | ana the unitary matrix Q := i I a l. Then 
he DO) e4 - RB R O 
sav [Ba] 0/828 gle 


Since 0 € W(V,B°*1V,-1) = W(R, Bt! RT"), by Theorem 1, DGMRES(A, b, a) 
has a partial stagnation of order at least one, a contradiction. Then B°*+! is 
a scalar matrix. 
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Zhou and Wei [11, Section 3] showed that for 2x2 matrices, the stagnation 
system has no relation with condition number of V and that the stagnation 
system always has a real root, where V is the Jordan transformation matrix 
of A. Indeed, in the following result, we show that for any 2 x 2 matrix A, 
DGMRES(A, b, a) does not stagnate for any Jordan transformation matrix 
V € M2(C) and be C?. 


Proposition 1. Let A be a nonzero singular 2 x 2 matrix with index a = 1 
and let b € C? be an arbitrary vector. Then DGMRES(A,b,a) does not 
stagnate. 


Proof. The Jordan decomposition of 2-by-2 matrix A has the following form: 


ep CO et 
sav [8] v-. 


Then B? = [A?] is a scalar matrix, and hence by Theorem 4, DGMRES(A, b, a) 
does not stagnate for any b € C?. 


In the following example, we show that by changing the right-hand side 
vector b, the stagnation of DGMRES(A, b, a) will be removed. 


Example 2. Let A= B@N, where 


2.5300 —0.4147 —0.6717 —0.3570 
Pe —0.4147 1.7306 0.8017 —0.4718 at Re O01 
~ | —0.6717 0.8017 —0.5233 0.5021 | ’ ~ 100 ]° 


—0.3570 —0.4718 0.5021 1.2627 


By choosing the vector b = [ 0.5291 —0.1187 —1.2012 —0.5129 0 0]* as the 
right-hand side vector, D@MRES(A, b, 2) has partial stagnation of order one 
(see Figure 1 (a)). 

By choosing 6 = [ 0.2277 0.4357 0.3111 0.9234 0.4302 0.1848 ]” , as a ran- 
dom vector, DGMRES(A, b, 2) does not stagnate (see Figure 1 (b)). 


6 Conclusion 


Let A be an n-by-n matrix with index a > 0 and let b € C”. A necessary and 
sufficient condition for partial stagnation of D@MRES(A, b, a) is obtained, 
and also for A € M,,(R), a sufficient condition for the non-existence of real 
stagnation vector b € R(A®) is studied. Moreover, a characterize for matrices 
A € M,(C) such that DGMRES(A, b, a) does not stagnate for every b € C” 
are considered. 
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Figure 1: (a) DGMRES(A, 8, 2) (b) DGMRES(A, 6, 2) 
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